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Abstract 

An approach to simultaneously optimize assignments of 
subjects to treatments followed by an end-of -mastery test is 
presented using the framework of Bayesian decision theory. 
The main advantages of the simultaneous approach compared to 
the separate are the more efficient use of data and the fact 
that more rec«listic utility structures can be used. The 
utility structure dealt with in this combined decision 
problem is a linear utility function. Decision rules are 
derived for quota- free as well as quota-restricted assignment 
situations when several culturally biased subpopulations of 
subjects are to be distinguished. The procedures are 
demonstracei^ with an empirical example of instructional 
decision making in an individualized study system. 

Keywords: decision theory, culture-fair placement, linear 
utility, quota-free placement, quota-restricted 
placement . 
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Introduction 

Statistical decision problems arise when a decision maker Is 
faced with the need to choose a preferred action that Is 
optimal In some sense. Moreover, one decision problem often 
leads to another, which, In turn, leads to a next one, and so 
on. An example Is test-based decision making In an 
Individualized study system (ISS) , which can be conceived of 
as an Instructional network consisting of various types of 
decisions as nodes (Vos & van der Linden, 1987; vos, 1990) . 
How should we model and analyse such sequences of decision 
problems within a Bayeslan decision-theoretic approach (e.g. 
DeGroot, 1970; Ferguson, 1967; Keeney & Raiffa, 1976; 
Llndgren, 1976) ? In general, two main approaches can be 
distinguished: either each decision can be optimized 
separately or all decisions simultaneously, in the former 
approach, the expected utility of each separate decision Is 
maximized sequentially while In the latter the overall 
expected utility of all decisions Is maximized 
simultaneously . 

It Is the purpose of this paper to demonstrate how rules 
for the simultaneous optimization of sequences of decisions 
can be found. Compared with the separate optimization of 
decisions, two main advantages can be Identified. First, when 
optimizing rules, decisions to be made lat&r In the decision 
network can already be taken Into account. As a result of 
this approach, rules can be found that make more efficient 
use of the data In the decision network. Also, the overall 
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expected utility will be increased. Second, more realistic 
utility structures can be handled by the simultaneous 
approach. 

Van der Linden (1985, 1988) has given an elegant 
typology of decision problems in educational and 
psychological testing. Each decision problem from this 
typology can be viewed as a specific configuration of three 
basic elements, namely a test, a treatment, and a criterion. 
With the aid of these elements, the following four different 
types of decision problems can be identified: selection, 
mastery, placement, and classification. 

Well-known examples of the four types of decision making 
in the field of education are admiss.-'on of students to 
educational programs (selection), pass-fail decisions 
(mastery) , the aptitude-treatment-interaction paradigm in 
instructional psychology where students are allowed to reach 
the same educational objectives via different instructional 
treatments (placement) , and vocational-guidance situations 
where, for instance, most appropriate continuation-schools 
must be identified (classification) . 

Each of the four elementary decision problems can be 
formalized as a problem of (empirical) Bayesian decision 
making. In Hambleton and Novick (1973), Huynh (1976, 1977), 
Mellenbergh & van der Linden (1981), Novick and Petersen 
(1976), Petersen (1976), Petersen and Novick (1976), van der 
Linden (1980, 1981, 1987), and Vos (1988), it is indicated 
how optimal decision rules can be found for these problems 
(analytically or numerically) . 
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In the present paper, the emphasis is on deriving 
simultaneous optimal decision rules for combinations of the 
elementary decisions. To illustrate the approach, a placement 
and a mastery decision will be combined into a simple 
decision network (see also Figure 1) . The difference between 
the separate and the simultaneous approach can be 
demonstrated by the combined placement--mastery decision of 
Figure 1. In the separate approach, first optimal placement 
rules are found by maximizing the overall expected utility 
for the separate placement decision (e.g., van der Linden, 
1981} . Next, optimal mastery rules are found by maximizing 
the overall expected utility for the separate mastery 
decision (e.g., Hambleton & Novick, 1973). In the 
simultaneous approach, however, the optimal placement as well 
as the optimal mastery rules are found by maximizing the 
overall expected utility of both decisions simultaneously. 
Also, when optimizing treatment-^assignment rules, pass-fail 
decisions to be made later can already be taken into account; 
hence, the first advantage of the simultaneous approach is 
nicely demonstrated by Figure 1. 

Besides the pure forms and combinations with each other, 
one or more of the following generalizations may apply (van 
der Linden, 1988) to the elementary decisions: 
11). Multiipie populations. The presence of different 

subpopulations reacting differently to the test items 

may create the problem of culture-fair decision making. 
(2) . QuQf.a restrictions . Due to Shortage of resources, the 

number of vacant places in some treatments is 

I) 
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restricted. 

(3) • Multivar iate data. The decisions are based on data 

from multiple tests. 

(4) • Mult ;t.v^y late criteria . The success Of a treatment has to 

be measured on more than one criterion each reflecting a 
different aspect of the treatment. 

In the present paper, only rastrictions with respect to 
the presence of subpopulations and the number of vacant 
places in some treatments will be assumed. First, we 
elaborate the decision-theoretic aspects of culture-fair 
decision making for a quota -free placement -mastery problem. 
For a linear utility function the decision rule that 
optimizes simultaneously the treatment assignments and the 
pass-fail decisions to be taken after the treatments are 
given. Next, optimal rules will be derived if allocation 
quota considerations have to be taken into account. Finally, 
optimal rutting scores for quota-free as well as quota- 
re^ icted combined decisions will be presented for an 
empirical application to instructional decision making in an 
ISS. In the numerical example, it is further assumed that the 
students can be separated into two subpopulations referred to 
as the disadvantaged and the advantaged populations. 

With resr)ect to the applicability of the approach 
presented in this paper, the following should be regarded* 
Although the area of individualized instruction is a useful 
application of simultaneous decision making, it should be 
emphasized that the procedures advocated in this paper have a 
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larger scope. For Instance, the simple placement ^mastery 
decision problem may be Important In such areas as 
psychotherapy In which It can be expected that patients react 
differentially to a certain kind of therapy and the most 
promising therapy Is followed by an end-of -therapy test* 

The Placement-Mastery Decision Problem 

In placement decisions several alternative treatments are 
available and It Is the decision maker's task to assign 
individuals to the most promising treatment on the basis of 
their test scores. All subjects are administered the same 
test and the success of each treatment Is measured by the 
same criterion. Figure 1 shows a flowchart of an ISS for the 
case of two Instructional treatments In which the treatment 
assignment Is followed by a mastery test. A test on the basis 
of which It Is decided whether the student has mastered the 
Instructional treatment sufficiently so that (s)he may 
proceed with the next treatment, or has to relearn the 
treatment and prepare him (her) self for a new test. 



Insert Figure 1 aoout here 



In the following, we shall suppose that In the 
placement-mastery decision problem the total population can 
be separated Into g (g ^ 2) subpopulations reacting 
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differently to the test Items. Let X be the placement test 
score variable^ Y the mastery test score variable, and let 
the true score variable T underlying Y denote the criterion 
common to the treatments j (j » 0,1), respectively. The 
variables X, Y, and T will be considered to be continuous. 

We consider a hypothetical experiment consisting of a 
population of students being exposed to each of both possible 
treatments but where the students are '^braln-^washed'* so that 
the effects of one treatment do not Interfere with those of 
another. (The actual experiment needed for parameter 
estimation and In which different samples of students are 
randomly assigned to the treatments will be described later 
on) . 

Furthermore, it is supposed that the relation between 
the measurements X, the measurements Y after treatment j, and 
the criterion T, can be represented for each population 1 (1 
- l,2,....,g) by a joint probability function ^i(x,y,t). 
Since the treatment is between the placement and the mastery 
test, it will influence the relation between X, Y and T, and 
this relation can be expected to assume a different shape for 
each treatment. This is indicated by the index j in 
^i(x,y,t). However, because the placement test is 
adniinistered previous to the treatments, the marginal 
probability function of X in subpopulation 1 is the same for 
both treatments and will be denoted by q^^ (x) . The above 
experiment being executed, the placement -^mastery decision 
problem now consists of setting simultaneously cut-off scores 
x^j^ and y^j^ such that, given the value of t^, the overall 
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expected titlllty Is maximized. It should be stressed that, 
although the nature of the decisions shown In Figures 1 and 2 
Is sequential, the cut-off scores x^j^ and y^j^ are optimized 
simultaneously using data coming from the above experiment. 

The presence of populations reacting differently to test 
Items Imply also different cut-off scores for each population 
(Gross & Su, 1975; Petersen & Novlck, 1976) . Therefore, let 
and y^j^ denote the cut-off scores for subpopulatlon 1 on 
the observed test score v«:;riables X and Y, respectively. 
However, the cut-off score t^ on the criterion score T 
separating "true masters** from **true nonmasters** Is assumed 
to be equal for each population. Note that, due to the 
presence of different populations r<:sactlng differently to 
test Items, different probability functions for each 
population should be assumed (Gross & Su, 1975; Petersen & 
Novlck, 1976) . 

In this paper, we consider only monotone decision rules 
5: students with test scores above a certain cutting point 
are considered **sultable** and **not suitable** otherwise. For 
the decision network of Figure 1 they can be defined In the 
following way: 



(1) 



5(X, Y) 



aoo 
aoi 
aio 

Ml 



for X < x^ir Y < ycl 
for X < Xcir X ^ ycl 
for X ^ Xcir Y < yci 
for X 2 Xcif Y ^ ycir 



where aj^ stands for the action either to retain (h » 0) or 
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advance (h « 1) a student who is assigned to treatment 
j (j * Orl). The problem of setting optimal cutting scores 
Xqj^ and Vcir given the value of tQ, now amounts to selecting 
1 monotone decision rule which maximizes overall expected 
utility. However, the restriction to a subset of all possible 
rules in our paper is only correct if there are no 
nonmonotone rules with higher expected utility. The 
conditions under which the subclass of monotone rules is 
essentially complete, i.e., that for any nonmonotone rule 
there is a monotone rule that is at least as good (Ferguson, 
1967, Sec. 6.1; Karlin & Rubin, 1956) will be examined in the 
next section.* 



Monotonicity Conditions 

For the elementary decisions the monotonicity conditions are 
known, and a monotone solution exists. The first condition is 
that the probability model relating observed test score 
variable Z to true score variable T has monotone likelihood 
ratio (MLR) in t, i.e. it is required that the ratio of 
likelihoods f (z 1 12) /f (z It]^) is nondecreasing in z for any t^ 
< t2« Second, the actions should be ordered such that for 
each two adjacent actions the utility functions possess at 
most one point of intersection. 

To guarantee that a monotone solution of the combined 
decision problem exists, it is assumed that, in addition to 
the conditions of MLR and monotone utility, the following 
conditions hold in each siibpopulation i for the probability 
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functions Vjj^(tlx), Pji(x,ylt), and njj^(ylx) of the 
distributions of T given X -x, (X^Y) given T « t, and Y given 
X » X under treatment j (j « OrDr respectively: 

(2) For any X]^ < X2r the ratio of likelihoods 
voi(t 1x2) /v^i (t Ix^) is nondecreasing in t, 

(3) For any ti < t2r the ratio of likelihoods 
Pji (x,y It2) /Pji(x,y It]^) is nondecreasing in each of 
its arguments, that is, MLR in each of its 
arguments, 

(4) For any x^^ < X2r the ratio of likelihoods 
nii(y 1x2) /nQj^ (ylx]^) is nondecreasing in y« 

After the utility function of the combined decision 
problem has been specified in the next section, and it has 
been indicated how the condition of monotone utility applies 
to this function, it will be proved that the above-mentioned 
conditions are sufficient for a monotone solution to exist. 

An Additive Representation of the 
Combined Utility Function 

Formally, a utility function Uj}^j^(t) describes all costs and 
benefits involved when action aj^ (j,h * 0,1) is taken for 
the student from subpopulation i whose true score is t« The 
decision-maker may have different utilities associated with 
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different populations (Gross & Su, 1975; Petersen & Novick, 
1976) • Hence, in addition to separate probability 
distributions, the decision-maker has to specify explicitly 
his/her utility function for each subpopulation separately • 

In the Introduction, it was remarked that one of the 
main advantages of the simultaneous approach was that more 
realistic utility structures could be used. This is nicely 
demonstrated by defining the utility structure of the 
combined decision problem as an additive function of the 
following form: 

(5) Ujhi(t) -wiUjip(t) +W2Uhiin(t), 

where Ujj^p(t), ^him^^)' ^1' ^2 represent the utility 

functions for the separate placement and mastery decisions, 
and two nonnegative weights respectively. The utility 
functions Ujj^p(t) and u^j^j^(t) are assessed separately and 
then brought onto the same scale by use of the weights wj^ and 
W2i A set of conditions sufficient for the existence of an 
additive value function may be found in Fishburn (1982), 
French (1986), Keeney and Raiffa (1976, Chapt. 3), and Krantz 
et al. (1971). Since utility must be measured at most on an 
interval scale, the utility function of (5) can always be 
rescaled (normalized) as follows; 

(6) «jhi<t) - wujip(t) + (l-w)Uhint(t), 

where the weight w should satisfy 0 ^ w ^ 1. The utility 

T .-^ 
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function Ujj;j^(t) now takes the following form: 



(7) 



Uhji(t) « ^ 



wuoip(t) + (l-w)uoiin(t) for j«0, h»0 

wuoip(t) + (l-w)uiin^(t) for j«0, h«l 

^llp<t) + (l-w)uoini(t) for j»l, h»0 

^ ^llp(t) + (l-w)uii,tj(t) for j«lr h»l. 



It Is reasonable to assume that the utility for granting 
mastery status Is a nondecreaslng function of a student's 
true score t, and the utility for denying mastery status Is 
nonlncreaslng. Hence, the difference of the two utilities, 
^llm^^) *^01m(^) ^ ^ nondecreaslng function of t. In the 
following, we shall suppose that the treatments have been 
ordered In such a way that treatment 1 can be considered as 
the '*hlgher" treatment. In general, students with high test 
scores on the placement test will be assigned to treatment 1, 
and vice versa. For Instance, treatment 1 may contain less 
examples and exercises than trefitment 0. Then, we may assume 
that U]^j^p(t) and uoj^p(t) are nondecreaslng and nonlncreaslng 
functions of t, respectively. Thus, It also follows that 
(^llp(^) *^01p(^)) ^ nondecreaslng function of t. Finally, 
since the difference of the two utilities for the separate 
decisions are nondecreaslng functions of t, the condition of 
monotone utility Is fulfilled for the utility functions of 
both separate decisions. 
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Maximization of Overall Expected Utility 

As noted earlier, the optimal procedure from a Bayesian point 
of view is to look for a rule chat maximizes the overall 
expected utility. Since we may confine ourselves to monotone 
rulesr the expected utility of a random student from 
subpopulation i for the simultaneous approach is given by 



(8) EtUjhi{T) lxci,ycil 



f^cifyci 

J J J uooi(t)^)i{x,y,t)dtdxdy + 



J J J uoii{t)r^i{x,y,t)dtdxdy + 

— • yci 

J J J uioi(t)nLi(x,y,t)dtdxdy + 
"** Xci 

i i i uni(t)fli_i(x,y,t)dtdxdy. 

— ^ci yci 



Substituting the additive utility function of (7) into (8), 
and rearranging terms, yields 

(9} E(Ujhi(T) lxci,yci] - J J Eo[uooi(T) lx,y]koi(x,y)dxdy 



J {Ei[uioi(T) lx]-Eo[uooi(T) Ix] lqi(x)dx + 

Xci 

(l-w){J {Eo[uiini(t)-uoim(t) lyl }soi(y)dy + 
yci 
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/ / qi(x) {{Ei[uiinj(t)-uoini(t) lx,y] }nii(ylx) 
^Eotuiini(t)-uoim(t) Ix,y] )noi(ylx) }clxdy}, 

where Sji(y) and kji(x,y) denote the probability function of 
Y and (X,Y) in subpopulation i under treatment j, 
respectively, and where Ej indicates that the expectation has 
been taken over a distribution indexed by j (j - 0,1). 

Now, the decision procedure is viewed as a series of 
separate decisions, each of which involves one random student 
from the total population. Furthermore, it is assumed that 
the overall expected utility for the simultaneous approach, 
EUsim<*cl'ycl' • • "''cg'ycg) ' found by summing the expected 
utility for the simultaneous approach of a random student 
over all students. Under these assumptions, it follovs that 
the overall expected utility for the simultaneous approach 
can be written as: 



g I 

(10) EUsiro^Xcl'Vcl' •••'''cg'ycg) ■ ^ PiECujhi(T) lxci,yci] 

i«l 



g 

where p^, ,S Pi = 1, is the proportion of students from 
i=l 

subpopulation i in the total population. 



Sufficiency of the Monotonicity Conditions 



There is a theorem in decision theory (see e.g., Chuang, 
Chen, and Novick, 1981) stating that E[u(e)iz) is a 
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nondecreasing function of z if f(zl6) has MLR and u(6) is a 

nondecreasing function of 9. We will refer to this property 

as monotone expected utility (MEU) . 

The utility associated with action aiQ, uioi(t), may 

either be a nondecreasing or a nonincreasing function of t. 

Since (-uooi(t)) is a nondecreasing function of t, and using 

the assumption of MLR of the probability function X given 

T-t, it follows by applying the MEU theorem that in the case 

of «ioi(t) being a nondecreasing function of t, 
d d 

i.e., - U0im<t)/{ tuiiplt)-uoiiR(t)] ) S w S 1, 

dt dt 

(El [uioi (T) Ix] - EotuQOi (T) Ix] ) is a nondecreasing function 
of X. Furthermore, since [uioi(t) - uooi(t)l • 
*'f"lip<t^ "'^Oip^^^ ^ (-UQOi ^ nondecreasing functions 
of t, and using the assumption of MLR of the probability 
function of X given T»t, it follows by applying the MEU 
theorem that both (Eq [uioi IT) Ix] - Bq tuQOi IT) Ix] ) and 
(-Eg [uQOi (T) Ix] ) are nondecreasing functions of x. In the 

case of uidi (t) being a strictly decreasing function of t, 

d d 

i.e., OSw < - — uoini(t)/{ uiip(t) - uoin,(t)]), 

dt 

and multiplying Eo[uioi IT) I x] by v^^ |t Ix) /vqi (t Ix) , it now 
follows under condition 2, which implies that 
vii(tlx)/voi(tlx) is nonincreasing in t, that (Ei [u^oi (T) Ix] 
- Eq [UQOi (T) Ix] ) is a nondecreasing function of x. Thus, for 
uioj^(t) being a nondecreasing as well as being a strictly 
increasing function of t, |Ei [uioi (T) Ix] - Eq [uQOi IT) Ix] ) is 
a nondecreasing function of x. Using q^Cx) 0, it then 
follows that the integrand of the second term of (9) is a 
nondecreasing function of x. 
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With the assumed MLR of the probability function of Y 
given T • t, and using [uii^Ct) -UQimCt) ] is nondecreasing in 
t and soj,(y) 2 0, it follows by the MEU theorem that the 
integrand of the third term of (9) is a nondecreasing 
function of y. 

Furthermore, since [uiini^^^ "^Oim^^) J is a nondecreasing 
function in t, it follows under condition 3 by applying 
the MEU theorem that <Ei [uiin,(t) -UQimCt) lx,y] ) and 
-<Eotuiinj(t)-uoini<t) lx,y] ) are nondecreasing and 
nonincreasing in each of their arguments x and y, respec- 
tively. Multiplying - (Eq [ujiniCt) - UQimCt) lx,y] ) by 
noi<ylx) /nii(y Ix) , it follows under condition 4, which 
implies that noi(ylx) /nii(ylx) is nondecreasing in y, that 
-<Eoluii„(t) - UQiaiCt) lx,yl) noi <y Ix) /nii (y Ix) is 
nondecreasing in each of its arguments. Multiplying both 
<Eituiira<t) - UQiniCt) lx,y]) and - (Eq [uiini<t) -UQimCt) Ix, y] ) 
noi<ylx) /nii(ylx) by njiCylx), and using nii(ylx), qi (x) 2 0, 
it now applies that the integrand of the fourth term of (9) 
is a nondecreasing function in each of its arguments. 

It finally follows that E[ujhi<T) lxci,yci] » ^i"^ hence 
Expression 10, possesses an absolute maximum because the 
first term is a constant, (1-w) 2 0, and the integrand of 
each term is nondecreasing in x, y, or in each of its 
argxoments x and y. In each new application it must be checked 
if the conditions of MLR, monotone utility, and (2) -(4) hold. 
Checking for the monotonicity conditions will be considered 
below after the (conditional) probability functions appearing 
in (9) have been specified. 
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Optimizing Cut;:ing Scores for Quota«-Free Placement 

With quota-free placement, there is no constraint on the 
number of students that can be assigned to one of the 
treatments* Thereforer the values of the optimal cutting 
scores, say x'^j^ and y'ci' which maximize Expression 10, can 
be obtainec'. by maximizing Expression 9 for each subpopulation 
i separately. The optimal rule can be derived by 
differentiating E[Ujj^j^(T) Ix^j^iy^j^] with respect to x^j^ and 
yci' setting the resulting expressions equal to zero, and 
solving for x^j^ and y^j^. 

First, differentiating Etuj^j^ (T) IxQi,yQj_] with respect 
to y^j^, and assuming w # 1, results in 

(11) soi(yci) {Eotuiini(t)-uoim(t) lycil ) + 

^li<yci)^ tBi[uiijn(t)-uoixa(t) lx,yci] )zii(xlyci)dx • 

Xci 

SOi<yciJ^ {Eo[uiini<t)-uoim(t) lx,yyil )20i(xlyci)cix - 

where Zji<xlyci) denotes the probability function of X given 
Y ' yci under treatment j in subpopulation i (j » 0,1). 
Similarly, differentiating ECUj^^ (T) Ix^j^^y^j^] with respect to 
using (x) > 0 (the possibility of qi (x) » 0 will 
be ignored) , yields 
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(12) Ei[uioi(T) Ixci] - Eo[uooi(T) Ixci] + 

00 

(l-w)J <<Ei[uiini(t)-uoijn(t) lxci,y]lnii(ylxci) - 
yci 

<Eo[uiini(t)-uoin^(t) Ixci.y] }noi(ylxci) }cly =- 0. 

Since the system or Equations 11 and 12 cannot be solved 
analytically for Xd and ydr the determination of the 
optimal cutting scores may be carried out via numerical 
approximation procedures such as the Newton iterative 
algorithm for solving nonlinear equations. However, before 
proceeding with this procedure, it is necessary to specify 
the probability functions, regression functions, and utility 
functions appearing in (11) and (12). 

BivariatiQ Normal Model 

In the following, we shall suppose that the variables X and Y 
have possibly different bivariate normal distributions under 
both treatments in each subpopulation i. Let pjj^ denote the 
population correlation between X and Y under treatment j in 
subpopulation i, and let x^] and yj^j denote the standardized 
scores of X and Y under treatment j (j 0,1), respectively. 
Then it can be shown (see e.g. Johnson & Kotz, 1970) that for 
the standardized bivariate normal distribution the 
conditional distribution of Xjj given Yj^j » yjjj is normal with 
expected value Pjiy^j variance (1-pji^) • Likewise, 

njj^(yijlx^) is normal with expected value pjiX^i and variance 
<1-Pji2) . 

The regression functions Eji(Tlx) and Eji(Tlx,y) of T on 
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X and T on X and y under treatment j, are assumed to be 
linear In each subpopulatlon 1; that Is, they can be written 
as Sji+FjiX and aji+PjiX+t j^y, respectively. Using results 
from classical test theory, It follows that the regression 
coefficients can be written as : 

(13) Fji - pji(CYji/Cxi) 
®jl " »*Yjl - TjiUxi 

Pjl - «yYjl/<Jxi) npji-pYjlPji^/d-pji^) } 

•«jl - (PYjl-Pjl^)/(l-Pjl^) 

ttjl " -»iXlPjl + »iYjl(l-5jl)» 

^^Yjl' V^Xi, *Yjl' *^X1' PYjl being the population means of 
Y and X, the population standard deviations of Y and X, and 
the reliability coefficient of Y under treatment j (j » 0,1) 
in subpopulatlon 1, respectively. Assuming also linear 
regression for T on y under both treatments in each 
subpopulatlon 1, and using Kelley's regression line (Lord & 
Novlck, 1968, p. 55), It follows 

(14) Ejidly) » pYji y + (l-pYji)^Yjl' 

Furthermore, assuming homoscedasclty, it also follows from 
classical test theory that: 
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(15) varji(Tlx) - (pYji-pji^XTYji^ 
varji(Tly) - Oy ji^PYji <l-PYji) 
varji(Tlx,y) - Oyji^ (PYji"p ji^-pYji^+pj^Spy^^, / 

(I-Pji^) . 

Having defined the probability and regression functions, 
we now are in a position for checking if the monotonicity 
conditions are satisfied. First, it can be noticed that, 
since the probability functions of T given X«»x, and T given 
X«K and Y»y in subpopulation i under treatment j are normal, 
they belong to the exponential family, and hence, they do 
have MLR and MLR in each of its arguments, respectively (see 
e.g., Chuang, Chen & Novick, 1981). Thus, monotonicity 
condition 3 is fulfilled. 

Furthermore, it can be shown (see e.g., Lehmann, 1959, 
sect. 3.13) that a necessary and sufficient condition for the 
likelihood ratios in (2) and (4) to be nondecreasing in t and 
in y, respectively, is that the mixed second derivative of 
the natural logarithm of these ratios exists and is 
nonnegative. Differentiating these ratios of normal 
distributions, it then applies that the following set of 
conditions should hold for conditions 2 and 4 respectively. 

(16) FQi/varQi (tIx) ^ Fii/varii (T Ix) 
Pli«»YOi/<l-Pli^) ^ POi<JYli/<l-POi^) • 
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Linear Utility 

Although utility functions can be empirically assessed 
without making any assumptions about the form of the utility 
functions (e.g. Vrljhof, Mellenbergh 6 van den Brink, 1983), 
usually the form of the utility function Is specified on a 
priori grounds, in statistical decision theory several forms 
of the utility functions have been adopted. In the present 
paper, It will be assumed that the utility structures for 
both the separate decisions are linear functions of the 
criterion variable t. This utility structure seems to be a 
realistic representation of the utilities actually incurred 
in many decision making situations. In a recent study, for 
Instance, it was shown by van der Gaag (1989) that many 
empirical utility structures could be approximated by linear 
functions. For other frequently used utility functions and 
their (dis) advantages, refer to Llndley (1976), Kevick and 
Llndley (1978), Swaminathan, Hambleton and Alglna (1975), and 
van der Linden (1981) . 

Mellenbergh and van Jer Linden (1981) and van der Linden 
and Mellenbergh (1977) proposed a linear utility function for 
the separate decisions. They can in the case of multiple 
populations be defined in the following way: 



(17) 



Ujip(t) 



^Oip(tc-t) + doip 
^ blip(t-tc) + diip 



for X < 
for X ^ Xjjj^ 



(18) 



Uhlm(t) 



' l3llm<t-tc) + diinj 



for Y < yci 
for Y i yci. 
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where boipr bnpr boimr and biin^ > 0* 

For each action, this function consists of a constant 
term and a term proportional to the difference between the 
criterion performance t of a student and the minimum level of 
satisfactory criterion performance t^* The parameters djj^p 
and d^iia (jrh « 0,1) can, for example, represent the constant 
amount of costs of following treatment j and the costs of 
testing, respectively, and will In that case have a 
nonposltlve value* The condition bQj^p, ^^lip > 0 Is equivalent 
to the ass\jmptlon that for assigning students to treatment 0 
and 1, utility Is a strictly decreasing and Increasing 
function of t, respectively. Likewise, boj^^^, b^^j^i^ > 0 
expresses the assumption that the utility for falling and 
advancing the mastery test Is a strictly decreasing and 
Increasing function of t, respectively. 

As Gross & Su (1975) and Petersen & Novlck (1976) pointed 
out, the question whether decision rules are fair to the 
various subpopulatlons which can be distinguished depend 
within a (ieclslon-theoretlc framework only on the chosen 
utilities* From this point of view, separate parameter values 
might be chosen In the linear utility model to allow for the 
fact that the students might belong to a disadvantaged or 
advantaged population (see also Mellenbergh & van der Linden, 
1981)* Suppose, for example, that population 2 Is considered 
more advantaged than 1 . Furthermore, it is assumed that 
Incorrect decisions are considered worse for population 1 
than for 2, while correct decisions are considered more 
valuable for population 1 than for 2. If so, bjip and h^^if^ 
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could be set higher than bj2p and hf^zm* respectively, for 
every value of t {j,h » 0,1). 

Substituting the assumed linear regression functions, 
bivariate normal probability functions, and linear utility 
functions in (11), it follows by integration over x: 

(19) f(xci,yci) « 

< <biini+boim) (PYOiyci+<l-PYOi)HYOi-tc) "^c^lim-^iOim) 

1 

VtYNOciJ/^'YOi + ^ j ^^ci'Vci' ■ 0' 
j»0 

where aj ■« 2j - 1, 

*j<«ci,yci) - Hbiinj+boim) (aji+pjiUxi+^jiyci"^ 
P ji<»XiPjiyNjci-tc) +dlim-doim> <l-*^t2xy jNci^ ) 
<blim+boim)Pji<yxi^<l-Pli^)9t2xyjNcil 9[yNjci3/ <»yji' 

and 9[.], and ZxyjNci (denote the standard normal 

distribution function, standard normal density, and 

<'*Nci~PjiyNjci) /^<l"Pji^) » respectively. Similarly^ it 
follows that (12) can be replaced by 

(20) g(Xci'yci) - 

1 

^2^tw<bjip(eji+rjiXci-tc)+ajdjip} 

(l-w){aj(boim(to-eji-rjiXci)+ dQin,) 

+ f j (xci.yci) n - o# 
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where 

f'j(xci,yci) - Hbiim+boim) (aji+tjiUYji+PjiXci + 
ji^YjiPji»«Nci-tc) + diinj-doiml (l-<I>[2yjxNcil) + 
(i'lim+boim)f jiOyji V(l-p2jj^) 9[ZyjxNci3' 

with ZyjxNci - <yNjci-PjiXNci)/^<l-P^ji) • 

To apply Newton's Iterative procedure, the partial 
derivatives of the lel't-hand side of (19) and (20) are 
needed. They are given as 

d 

(21) f(Xcl'yci) • 

axci 

-Z {aj[V(l-pii2,<,^^^]-l 9[yjji^i] { (bii„+boim) 
j»0 

(Oji+pjiXci+tjiyci-tc)+dii^^-doini)(p[2xjNcll/a"Xci ' 
d 

(22) f(Xcl'ycl) " 

9yci 

-{ (biim+boim) (PYOiyci+ <l-PYOl) ^^YOi-tc) +diini-doini} 

yNOclVtyNOcil /<'fY01^+ <biini+boijn)pYOi9[yNOcl3 /OyOI 
1 

'jfo^ ^j^^ci'yci)yNjci9[yNjcii/<'Yji^ + 

<aj(biini+boini) { (t ji^Y ji+PjiPji<Jxi) 
(l-0(zx jNciJ ) +Pji [V (1-p ji2) ] -1 

<P(ZxjNcinaji+3jiXci+Xjiyci-tc)) + (diini-doin»)Pji 
tV(l-pji2,]-l (pCzxjNciDVtyNjcil/OYji^ U 



A Simultaneous Approach 

25 



d 

(23) — g(xci,yci) 



w(biiprii+boiproi) + (i-w)boini(roi-rii) + 
1 

j=0*^ ^ <bli„+boini) /Cxi{ (PjiCxi*^ ji^YjiPji) 

(l-«I>t2yjxNcil ) +Pji (l-Pji^) ] <P(2yjxNci] 
<aji+3jiXci+Xjiyci-tc) )+ (diim-doim) Pji t^d" 
pji2)Oxi3-l 

VtZyjxNcil' 



d 

(24) glxci,yci) 

dxci 



S aj (1-w) { [V(l-pji2,c^j^j-l {-(bii^+boim) 
<aji+PjiXci+Xjiyci-tc) + (doim-diim) }<PCzyjxNcil • 



Inserting Equations 19 until 24 into Newton's procedure, 
and using the property that the standard normal distributions 
appearing in this system of Equations can be approximated by 
logistic functions with a scale parameter equ&l to 1.7 (Lord 
& Novick, 1968, sect. 17.2), o.i*» obtains the optimal cutting 
scores x'^^ and y'ci. The algorithm is implemented in a 
computer program called NEWTON. 

Derivation of Optimal Separate Decisions 

The expected utility of a random student for the separate 
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mastery decision from subpopulation i, ^ [u^im ' Veil ' 
follows immediately from (9) by realizing that both 
treatments can be thought to coincide in this case implying 
that noi(ylx) = n^iiylx) and Eq[.] - Ei(.]. Also, the 
combined additive utility function, Uj^i (t) , can be replaced 
in this case b-j C "him^t) ] implying that amongst others 
uioi(t) « uooi(t) • (l-^"^)uoini' Furthermore, the placement 
test score variable X can be thought to coincide with the 
true score variable T in this case implying that the first 
term of (9) reduces to (1-w) J Eq [uQim^T) lylsgi (y)dy . 
Substituting the above-mentioned equalities into (9) , results 
in 

OO 

(25) E[Uhini(T) lyci] » (1-w) { J Eo[uoiia(T) lylSQi (y)dy + 

00 

/ <Eo[uiinj(t) - uoini(t) ly] }soi(y)dy) . 
Vci 

The optimal separate mastery scores, y'ci' 
derived again by differentiating E[uhini(T) lygi] with respect 
to y^^j^, setting the resulting expression equal to zero« and 
solving for y^i. Doing so, and using soi(yci)>0 and w i* 1, 
results in 

(26) Eo[uiini(t)-uoini(t) lyci] -0, 

which yields the same optimal cutting score y' ^i the one 
given by van der Linden and Mellenbergh (1977) . For the 

31 
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linear vtility model (Expression 18), it follows from (26) 
that 

<27) y'ci - HyOL + <tc-^«.YOi+(cioim-diim)/(biim+boim))/PYOi. 

As an aside, it may be noted that Equation 26, and hence 
Equation 27, can also be derived immediately by substituting 
the equalities soi(yci) " sii(yci), ZQi^^lyci) - 2ii(xlyci)» 
andEo[.] »Ex[.] into (11). 

Next, the expected utility of a random student for the 

separate placement decision from subpopulation i, 

E[Ujip (T) Ixci] , can easily be derived from (9) by realizing 

that in the combined additive utility function, Ujjj^ (t) , the 

term [ (l-w)Uhini(t) ] vanishes in this case implying that the 

third term of (9) also vanishes, and the second term of (9) 

reduces to [w J {Ei[uiip(T) |x]-Eo[uoip(T) |x] }qi(x)dx] . 

*ci 

Furthermore, the mastery test score variable Y can be thought 
to coincide with the true score variable T in this case 
implying that the first term of (9) reduces to 

o* 

/ Eq I"Oip(THx]qi(x)dx. Substituting the above-mentioned 
-•• 

results into (9), yields 

(28) E[Ujip(T) IXci] « w{i Eo[uoip(T) |x]qi(x)clx + 

-00 

oo 

/ {Ei[uiip(T) lx]-Eo[uoip(T) Ix] }qi (x)dx}. 



The expected utility for a random student from 
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subpopulatlon 1 for tAe separate approach Is found by summing 
EtUhimO IVclI ^'^^ E[Ujip(T) IXgi] . Finally, analogously to 
the simultaneous approach, the overall expected utility for 
the separate approach, EUsep(Xcl' Vol' ''eg' ycg) ' is 

found by summing the expected utility for the separate 
approach of a random student over all students yielding 

(29) . EUsep(Xcl'ycl' •••'^cg'^cg) 

g 

- I Pi{E[Uiiin(T) lyciJ+ElUjipd) Ixci] }. 
i»l 

The optimal separate placement cutting scores, y'cl' 
follow now again by differentiating ECuj^p (T) IXdJ with 
respect to x^j,, setting the resulting expression equal to 
zero, and solving for x^j^. Doing so, and using qj,(x) > 0 and 
w «k 0, results In 

(30) Eituiip(T) |Xci]-EoCuoip(TI|Xci] » 0. 

Also, this optimal solution agrees with the one reached by 
van der Linden (1981) , Adopting the linear utility model from 
Expression 17 In (30), It applies that 

(31) x'ci - {doip-diip+tc(biip+boip)-biip9ii-boipeoi}/ 

<biipr ii+^oiproi) . 

Equation 30, and hence Equation 31, can also easily be 
derived by putting (l-w)uii„ - (l-w)uoini - 0 In (12). 
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As a final remark, it should be noted that the optimal 
separate cutting scores, unlike the expected utilities for 
the separate decisions, do not depend upon the value of w. On 
the other hand, the optimal cutting scores as well as the 
expected utilities for the simultaneous approach depend upon 
the value of w. 

Solution for Quota-Restricted Placement 

In the restricted placement situation only a fixed number of 
students can be assigned to each treatment. Confining 
ourselves to assignment decisions with two treatments, this 
constraint can be expressed as 

(32) PO - 2 PitProb(X ^ Xci) ] - .^^Piil qi(x)dx], 

i*l i«l XQj_ 

g 

where 0 < pg < I Pi » 1 represents the fixed proportion of 
i«l 

all students that can be assigned to treatment 1. 

Analogous to the quota- free model, optimal cutting 
scores x'^^ and y'^^ can be derived by maximization of the 
overall expected utility for the simultaneous approach from 
Equation 10 subject to (32) . To solve this constrained 
optimization problem, first introduce the placement 
restriction into the function to be optimized (Equation 10) 
through a Lagrange multiplier X: 



34 



f 
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(33) I-OScl'ycl Xcg'Vcg'^) - i5iPiECui(T) Ixci^yd] + 

g oo 

MS Pi [J qi(x)dx]-po}, 

Xci 

where X Is a constant. First, differentiating 
l*(Xci,ycl, . . . ,Xcg,ycg,X) with respect to Yd setting the 
resulting expression equal to zero yields the same solution 
as the solution for quota-free placement given by Equation 
11. Next, differentiating of L(Xci,yci, . . .,Xcg,ycg,X) with 
respect to X, setting the resulting expression equal to zero 
yields, of course. Equation 32. Finally, differentiating 
I<<Xci#ycl» •••»Xcg,ycg,X) with respect to x^^, setting the 
resulting expression equal to zero, and using p^, qi(x) > 0, 
yields 

(34) Eituioid) Ixci] - Eo(uooi(T) Ixcil +X + 

OO 

(l-w)J {{Ei[uiijn(t)-uoini(t) lxci,y]}nii(ylxci) - 
Vci 

<Eo[uiim<t)-uoiai(t) lxci,y] }noi(ylxci) }dy - 0. 

Now, optimizing cutting scores for quota-restricted 
placement proceeds by substituting the assumed probability, 
regression, and utility functions into Equations 11, 32, and 
34 and solving this system of Equations for the (2g 1) 
unknown parameters x^i, y^^, and X using Newton's iterative 
method again. For the linear utility model this results in 
the system of nonlinear Equations fk^Qit^d), (32), and 

imc 35 
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9(xci'yciJ respectively. Note that with quota-restricted 

placement, unlike quota*free placement, the optimal cutting 

scores x'^j^ and y' ^i ( i ■ l,...,g) are dependent upon each 

other. Also, the partial derivatives of the given system of 

nonlinear Equations is required again « The derivatives of 

f(Xci#yci) and g(Xci,yci) with respect to Xd and y^i were 

given already in the preceding sections. Furthermore, it can 

d d 
easily be derived that [g(Xci,yci)+A.] - g(Xci#yci)# 

r — lg<xci'yci)+^l • — g(xci'yci)' -rr— Ig<Xci»yci)+^l 
«yci oyci 9^ 

- 1. Since qi(x) is a normal distribution with mear ^^i 
variance (Txi^ (see, e.g., Johnson & Kotz, 1972), it finally 
follows from (32) that 



ag o. 

(35) { SpitJ qi(x)cbc]-po} « (-Pi/OxiXptXNcil • 

dXgi i-1 

When there are allocation quota considerations, the set 

of given monotonicity conditions do not hold without 

modifications. Since X is a constant, it follows directly 

from (11) and (34) that this set is also sufficient to 

guarantee that the integrand of each term in 

I'(Xci,ygl, . . .,Xcg, ygg,X) is nondecreasing in x.. y, or in each 

of its arguments x and y. In addition to these conditions, it 

should hold that L(Xgi,ygi, . ..,Xgg, ygg,X) is a nondecreasing 
d 

in X or L(Xci,yci, . . .,Xgg,ycg,X) k 0. Using (33), then 
the following extra monotonicity condition can be formulated 
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g oo 

(36) S Pi (J qi(x)dx] S Pq. 

Since the above stated condition should hold for every value 
of Xq^i It follows that 

g 

(37) S Pit ^ J qi(x)dx] S pg, 
i*l ^'cir 5ree 

where x'ci,free denote the optimal placement cutting scores 
in the quota-free model. Furthermore, let x'ci^q^Q^3 denote 
the optimal placement cutting scores in the restricted model, 
then it will generally hold that x'ci, quota ^ «'ci, free' 
because fewer students can be assigned to treatment 1 in the 
restricted model. Since the left-hand side of (36)) is a 
nondecreasing function in x^i and is equal to pq when x^i « 
^'ci, quota' it follows that 

g ^ 

S Pi[/ qi(x)dx] a PQ, for x'ci^f^ge ^ *cl ^ 5*' ci, quota' 
1«1 Xci 

Hence, using (x'^i^ f^ee'^'ci, free^ *® * first approximation 
in Newton's iterative procedure guarantees that 
L(Xc],,yci, . . .,Xcg,ycg,X.) reaches its maximum for one pair of 
cutting scores. 

It should be noted that condition 37 can easily be seen 
to hold by realizing that if the left-hand side of condition 
37 is less than Pq, this implies that fewer students are 
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assigned to treatment 1 than the number of places available. 
In applying the quota'*restrictecl model, it must always be 
checked if condition 37 holds. If this is not the case, the 
optimal placement cutting scores of the unrestricted model 
should be used. To compute the optimal cutting scores with 
quota-restricted placement for the linear utility model, the 
computer program QUO-SIM has been developed. 

Analogously to the quota- free model, the optimal 
separate cutting scores can easily be derived from Equations 
11, 32, and 34 by imposing certain restrictions. The optimal 
separate mastery scores, y'ci' follow again immediately from 
(11) by substituting the equalities SQityci) - siiy^i) , 
2oi(xlyci) •" zii(xlyci)» andEot.] -Eit.l into (11) yielding 
Equation 27 in case of the linear utility model. 

However, unlike the optimal separate mastery decision, 
the optimal separate placement decision for the quota- 
restricted model differs from the quota-free model. The 
optimal separate placement scores, q^, follow by first 
putting (l-w)uoini(t) - (l-w)uiim(t) - 0 in (34) yielding 

(38) Ei[uiip(T) |Xci]-Eo[uoip(T) Ixci] + X - 0. 

Next, substituting the linear utility and linear regression 
functions into (38), results in 

(39) XciCbiipFii+boiproi) - (doip-diip) - 

" tc<biip+boip) + blipQli + boipSoi + A. = 0. 
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Now, the optimal separate placement scores for the 
quota-restricted model are found by solving the nonlinear 
system of Equations 32 and 39 for the (g+1) unknown 
parameters x^j^ and X using Newton's Iterative algorithm 
again. Analogously to the simultaneous approach. It should be 
noted that with quota-restricted placement, unlike quota-free 
placement, the optimal cutting scores x'^j^ (l^l, . . .,g) are 
dependent upon each other. In order to apply Newton's 
Iterative method to solve the given system of nonlinear 
Equations, the partial derivatives are required again. The 
derivatives of (32) with respect to x^j^ were given already In 
(35) . Finally, from (39) It can easily be verified that the 
derivatives of the left-hand side of (39) with respect to k 
and Xci are given by 1 and (biipFii + boipFoi) , respectively. 

Finally, It should be noted that, analogously to the 
quota-free model, condition 37 should hold In order to 
guarantee that no fewer students are assigned to treatment 1 
than the number of places available; that Is, the Lagranglan 
function Is nondecreaslng In X, In condition 37, x'^i^f^ee 
denote now, of course, the optimal separate placement cutting 
scores of the quota-free model. If the resulting sum of 
products of the left-hand side of (37) Is less than pq, then 
the decision-maker jhould use again the optimal separate 
placement cutting scores of the unrestricted model. 

A computer program called QUO-SEP has been written to 
obtain the optimal separate placement cutting scores for the 
quota-restricted model. To Illustrate the models presented In 
this paper, a numerical example Is given In the next section. 
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An Application of the Combined D'iclslon Problem 

The procedure for computing the optimal cutting scores was 
applied to a sample of 59 freshmen in medicine. Bo-h the 
placement and mastery test was composed of 21 free-response 
Items on elementary medical knowledge with test scores 
ranging from 0-100. The treatments 0 and 1 consisted of an 
Interactive video (IV) and a computer-aided Instructional 
(CAl) program, respectively. Since the IV-program contained 
more exaunples and exercises, treatment 1 was considered as 
the "higher" treatment. 

Due to previous schooling, the total sample of 59 
students could be separated with respect to elementary 
medical knowledge into a disadvantaged and an advantaged 
population of 31 and 26 students referred to as populations 1 
and 2, respectively. The normal models assumed for the 
distributions Xj, and Yj^ <j » 0,i; 1 - 1,2) showed a 
satisfactory fit to the test data for a Kolmogorov-Smlrnov 
goodness-of-flt test. 

The teachers of the course considered a student as 
having mastered the subject matter if (s)he could answer 
correctly at least 55% of the total domain of Items. 
Therefore, t^ was fixed at 0.55. 

The means, standard deviations, euid correlations between 
X and Y were computed for each subpopulatlon under both 
treatments using the unbiased maximum likelihood estimates of 
the sample means, sample standard deviations, and sample 
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correlations, respectively. Furthermore, since the items were 
not scored as right or wrong, the reliabilities of the test 
Scores were estimated as coefficient a (Cronbach, 1951) for 
each subpopulation under both treatments. The results are 
reported in Table 1. 



It is important to notice that the necessary statistics come 
from the correct experiment and not, for example, from ISS's 
in which students are already assigned to treatments on the 
basis of their scores on the placement test in question. In a 
proper experiment students from the same probability function 
of X are randomly drawn and assigned to treatments, after 
which their performances on the mastery test are measured. 

As noted earlier, in each application of the combined 
decision problem it should be checked if the monotonicity 
conditions hold. Substituting the statistics of Table 1 into 
(13) and (15), showed that the set of conditions (16) was 
satisfied. 

First, the quota-*free situation is considered. Because 
the costs for testing are assumed to be equal for advanced 
and retained students, d^^j^^ is set equal to dh2m " 0,1) • 
Similarly, the costs of following the different treatments j 
(j » 0,1) are equal: djip » dj2p. Furthermore, it should hold 
that bjip > bj2p and b^iin > ^hZm^ taking into account the 



Insert Table 1 about here 
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fact that population 2 was considered more advantaged than 1. 
Using the computer program LINEAR, the optimal cutting scores 
x'ci and y'^^ were then obtained by solving iteratively the 
system of Equations 19 and 20 for and yd (i-1,2) with t^ 
as starting values. The criterion for convergence was that 
the absolute differences between two iteration steps for both 
x'ci and y'ci were smaller than 10"'^. The results are 
reported in Table 2 for 3 different values of the utility 
parameters as well as for w = O.S, 0.9, and 0.1 to illustrate 
the dependence of the results on the utility structure. 



Insert Table 2 about here 



The table shows that the consequence of raising the value of 
w is generally a decrease of the optimal placement scores and 
a small increase of the optimal mastery scores. Thus, 
increasing influence of the utility associated with the 
mastery decision implies that students should be assigned 
sooner to the "lower" treatment, in particular, the optimal 
placement cutting scores should be raised considerably for w 
" 0.1. This can be argued by the fact that the increasing 
influence of the utility associated with the mastery decision 
implies that students should be assigned sooner to the 
"lowe.:" treatment in order to prepare them better for the 
mastery test at the end of the treatment. Besides, this 
better preparation for the mastery test accounts for the fact 
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that the optimal mastery scores can generally be set slightly 
lower with increasing w. Furthermore, inspection of Table 2 
shows that both the optimal placement and mastery scores are 
lower for the advantaged than for the disadvantaged group. 
This is so because the disadvantaged students should be 
assigned sooner to the "lower" treatment. Also, they should 
stay longer in the instructional treatment to be sure that 
they have mastered the educational objectives. 

In Table 2 the optimal cutting scores for the separate 
decisions are also displayed. The cutting scores optimizing 
the separate decisions were computed using Equations 27 and 
31. As can be seen from Table 2, the optimal cutting points 
for the separate model do generally not have large 
differences compared to those in the combined model for w«0.5 
and w-0.9 for both subpopulations. However, for w-0.1 the 
optimal cutting points for the placement decision of the 
combined mcdel are substantially higher for both 
subpopulations. This can be explained by realizing that, as 
noted before, the psychometric portion of the separate model 
for optimizing the separate cutting scores does not depend 
upon the value of w. Furthermore, it has been argued before 
why the optimal cutting points for the placement decision of 
the combined model should be set rather high for wbO.1. 

In the Introduction, it was remarked that one of the 
main advantages of the simultaneous approach was the increase 
of the overall expected utility. This can be demonstrated by 
comparing the gain in overall expected utility of the 
simulteuieous to the separate approach, in order to calculate 
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the overall expected utility for the simultaneous approach, 
first the computed optimal simultaneous cutting scores from 
Table 2 were substituted into (9) for both subpopulations and 
the overall expected utility was calculated according to 
(10). The fourth term in the right-hand side of (9) has been 
computed using numerical integration methods, while the first 
three terms have been integrated analytically yielding 
respectively 

{wboip+(l-w)boini} (tc-aoi-Poi^lxi-'5 0i^lYOi) + 
wdoip+(l-w) doim, 

{ (wbiip- (1-w) boi) (Oii+riiUxi-tc) + <wboip+ (1-w) boim) 
<8oi+roi»lxi-tc)+w(dlip-doipn{l-«IXNci]} + Oxi^Pl^Ncil 

{w<riibiip+roiboip) + (i-w)boim(roi-rii)}, 

<l-w){{(boim+biini) (Hyoi-tc) +diini-doim} { l-OIyjjOciH + 
<'Y0iPY0i vboim+l^lim) VlVNOcil > • 

Similarly, the overall expected utility for the separate 
approach was calculated by substituting the optimal separate 
cutting scores from Table 2 into Equations 25 and 28 for both 
subpopulations followed by the summation according to (29) . 
The first and second term in the right-hand sides of (25) and 
(28) have been integrated analytically yielding respectively 

(1-w) (boim(tc-HYOi) + clOimJ' 
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(1-w) { { (boim+blim) >lYOi-tc) +dun^-doim) O^CyNOci] ) + 

w{boip<tc-eoi-roi^xi) ^ ^oip), 
wn{biip(9ii+riitixi-tc) * boipOoi+rJi^xi-tc) * 

<ilip-doip)(l-<»[XNci]) + «Fxi(riibiip+roiboip)9tXNci])- 

Computer programs EU-SIM and EU-SEP have been written to 
calculate the overall expected utility for the simultaneous 
and separate approach, respectively « Table 2 summarizes the 
results • 

As can be seen from Table 2, the gain in overall 
expected utility for this particular example and chosen 
utility structures {l)-(9) not very much* Only for utility 
structure (9) with w-0.1 the gain is substantially. This can 
be argued by the fact that the utility associated with the 
mastery decision is dominating in this case. Now, due to the 
high optimal placement cutting scores for the combined model, 
most students will be assigned to the "lower** treatment 
implying that on the average they are better nrepared for the 
end-of-mastery test. As a result, due to the high positive 
utility associated with the advance decision for this 
particular utility structure, the overall expected utility 
will be rather large. 

Note that for both approaches the overall expected 
utility increases with decreasing w. This means that the 
utility associated with the separate mastery aecision 
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contributes the most to the overall expected utility. 

Finally, the solution for quota-restricted placement for 
the combined model is considered. The proportions pj^ (i « 
1,2} were estimated as nj^/n, where n and nj_ stand for the 
total sample and the number of students from the sample in 
subpopulation i, respectively. Furthermore, the fixed 
proportion pq of the total student population that could be 
assigned to treatment 1 was arbitrarily set equal to 0.333. 
The optimal cutting scores were then computed using the 
computer program QUO-SIM; the results are summarized in Table 
3. The optimal solutions of the unrestricted model were used 
as first approximations in the iterative procedure. As 
mentioned earlier, before optimizing the cutting scores for 
quota-restricted placement, it should be checked if condition 
37 holds. Inserting the solutions of the quota-free model, it 
appeared that this condition was satisfied for all values of 
the utility parameters and all values of w. 



Insert Table 3 about here 



As can be seen from Table 3, the optimal placement scores 
x'qi and x'g2 in the quota-restricted model have to be raised 
substantially for the disadvantaged as well as advantaged 
groups compared to those in the quota-free model, because 
fewer students can be assigned to treatment 1 in the 
restricted situation. On the other hand, the optimal mastery 
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scores y'^^ ^'^^ V' c2 ^'^ quota-restricted model can be set 
slightly lower for both the disadvantaged and advantaged 
groups compared to those in the unrestricted model. This can 
be explained by realizing that only the "33.33% best" 
students are assigned to the "higher" treatment 1 implying 
that the remaining 66.66% low and average students are 
assigned to the "lower" treatment 0 where they are provided 
with more examples are exercises. As a result, the average 
student will be prepared better for the mastery test; hence, 
the optimal mastery scores can be set slightly lower. 

Furthermore, it follows from Table 3 that, analogous to 
the unrestricted situation, the optimal mastery scores are 
higher for the disadvantaged than for the advantaged group. 
Unlike the quota-free situation, however, the optimal 
placement scores are higher for the advantaged than for the 
disadvantaged group for w»0.5 and 0.9 implying that 
disadvantaged students are sooner assigned to treatment 1 
than advantaged students in these cases. This can be argued 
by the fact that, since the number of vacant places available 
for the "higher" treatment is restricted, otherwise hardly no 
disadvantaged students should be assigned to the "higher" 
treatment. However, since the influence of the utility 
associated with the mastery decision for w»0.1 is rather 
high, the disadvantaged students should be assigned sooner to 
the "lower" treatment in that case. 

Also, the optimal separate scores for the quota- 
restricted model have been computed again. The optimal 
separate mastery scores are, of course, the same as those 
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obtained by the simultaneous approach. The optimal separate 
placement scores can be found by computing Iteratlvely the 
system of Equations 32 and 39. Checking for condition 37, it 
appeared again that this condition was fulfilled; the results 
are shown in Table 3. 

Finally, the overall expected utilities were calculated 
for the quota-restricted model analogously to the quota-free 
model. The results are also reported in Table 3. Note that, 
the overall expected utilities for both approaches is lower 
in the quota-restricted model. This result is in accordance 
with the theory of constrained optimization (see e.g., 
Bertsekas, 1982) . 

Discussion 

In this paper an approach to simultaneous decision making for 
combinations of elementary decisions was described. The 
approach was applied to the area of instructional decision 
making by combining two elementary decisions (viz. a 
placement and a mastery decision) into a simple ISS. It was 
indicated that the optimal placement cutting scores obtained 
by the simultaneous approach in some cases differed 
substantially from those obtained by the separate approach. 
In particular, if it wts assumed that the influence of the 
utility function associated with the placement decision was 
small, it turned out that the cutting points for the 
placement decision yielded rather large differences. It was 
indicated how by simultaneous optimization of such sequences 
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of decisionSr optimal routing decisions could be taken using 
the framework of Bayesian decision theory. 

The solutions given in this paper only apply to 
treatment assignment problems followed by an end-of-mastery 
test. However, more complicated decision networks can be 
handled effectively within a decision-theoretic framework. 
Further examination of the "best** way to represent more 
complicated decision networks of combinations of elementary 
decisions seems a valuable line of research. By simultaneous 
optimization of such sequences of decisions, optimal 
decisions can be taken using the framework of Bayesian 
decision theory. Also, restrictions such as multivariate test 
data and criteria can be taken into account. Furthermore, the 
optimization methods can be readily generalized to more than 
two treatments by introducing a series of cutting scores on 
the placement test. 

Two final remarks are appropriate. First, it should be 
noted that the monotonicity conditions 2 and 4 are less 
restrictive than they look at first sight. As noted earlier, 
condition 2 should only hold if u^^Qj^tt) is a strictly 
decreasing function of t; that is if 0 S w < bQin^/ (bi^p+boim) 
in case of the linear utility model. Besides, since condition 
2 is a sufficient condition, even if condition 2 does not 
hold for uxoi (t) is a strictly decreasing function of t, the 
integrand of the second term of (9) still may be a 
nondecreasing function of x. This may be the case whenever 
BoIuoOi^*^) 1^1 is a more slowly decreasing function of x than 
Ei[uioi (T) |x] . For the linear utility model this condition 
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d 

boils down to — — EQi(T|x) > 
dx 



d 



Eli (Tlx) or Toi > T^^. 



Similarly r the fourth term of (9) still may be a 
nondecreaslng function in each of its argxoments x and y 
whenever [Eo[uiin^{t)-uoiyji{t) |x,y]noi{y|x) ] is a more slowly 
increasing function in each of its arguments x and y than 
lEi[uiin^(t)-uoiin{t) Ixryjnii (ylx)]. 

Second, the example given in this paper was used only to 
illustrate the models. However, it is recommended not to use 
such small samples as in the described experiment, because 
the parameters to be estimated can yield errors of estimation 
in that case« If so, they can propagate in comput.lug the 
derived optimal decision rules. This does not mean, however, 
that small samples necessarily yield inaccurate results. This 
is because not only distributional parameters but utility 
parameters as well determine how errors of estimation 
propagate . 
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Author's Note 



This article is based on a paper read at the European Meeting 
of the Psychometric Society in Leuven, Belgium, 17-19 July, 
1989. The author wishes to thank Wim J. van der Linden, Sebie 
J. Oosterloo and Paul Westers for their helpful comments and 
Jan Gulmans for providing the data for the illustration. 
Details of the derivations and copies of the computer 
programs NEWTON, QUO-SIM, QUO-SEP, EU-SIM, and EU-SEP are 
available upon request from the author. 
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X Y X Y 
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